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Abstract 

In this paper we propose search strategies for heterogeneous multi-agent systems. Multiple agents, 
equipped with communication gadget, computational capability, and sensors having heterogeneous ca- 
pabilities, are deployed in the search space to gather information such as presence of targets. Lack of 
information about the search space is modeled as an uncertainty density distribution. The uncertainty 
is reduced on collection of information by the search agents. We propose a generaUzation of Voronoi 
partition incorporating the heterogeneity in sensor capabilities, and design optimal deployment strategies 
for multiple agents, maximizing a single step search effectiveness. The optimal deployment forms the 
basis for two search strategies, namely, heterogeneous sequential deploy and search and heterogeneous 
combined deploy and search. We prove that the proposed strategies can reduce the uncertainty density to 
arbitrarily low level under ideal conditions. We provide a few formal analysis results related to stability 
and convergence of the proposed control laws, and to spatial distributedness of the strategies under 
constraints such as limit on maximum speed of agents, agents moving with constant speed and limit on 
sensor range. Simulation results are provided to validate the theoretical results presented in the paper 
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I. Introduction 

A. Multi-agent systems 

Solving complex problems requires higher intelligence, which nature has gifted to human 
beings. An alternative to higher individual intelligence is cooperation among individuals with 
limited intelligence. Such group intelligence is exhibited in nature by swarms of bees, flocks of 
birds, schools of fish etc. In these, and in myriad such examples from nature, the key factor is 
cooperation with limited, local, and noisy communication among individuals in a large group. 
The individuals are governed by a set of simple behavior leading to a more complex and useful 
emergent group behavior. Honey bees' nests, territories of the male Tilapia Mossambica etc., 
exhibit a kind of locational optimization which can be interpreted in terms of centroidal Voronoi 
configurations [1]. This kind of optimal behavior is also an outcome of a set of rudimentary 
decisions by individuals with local interactions. 

Inspired by nature, scientists and engineers have developed the concept of multi-agent systems 
with robots, UAVs, etc., as agents. These multi-agent systems can perform a wide variety of 
tasks such as search and rescue, surveillance, achieve and maintain spatial formations, move as 
flocks while avoiding obstacles, multiple source identification and several other tasks. 

B. Search using multiple agents 

One of the very useful application of multi-agent systems is search and surveillance. Searching 
for the presence of targets of interest, survivors in a disaster, or information of interest in a 
large, possibly un-mapped geographical area, is an interesting and practically useful problem. 
The problem of searching for targets in unknown environments has been addressed in the 
literature in the past under restrictive conditions [2]-[5]. These seminal contributions were mostly 
theoretical in nature and were applicable to a single agent searching for single or multiple, and 
static or moving, targets. Cooperative search by multiple agents have been studied by various 
researchers. Enns et al. [6] use predefined lanes prioritizing them with the probability of existence 
of the target. The vehicles cooperate in that the total path length covered by them is minimized 
while exhaustively searching the area. A dynamic inversion based control law is used to make 
the vehicles follow the assigned tracks or lanes while considering the maximum turn radius 
constraint. Spires and Goldsmith [7] use space filling curves such as Hilbert curves to cover a 
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given space and perform exhaustive search by multiple robots. Vincent and Rubin [8] address 
the problem of cooperative search strategies for unmanned aerial vehicles (UAVs) searching 
for moving, possibly evading, targets in a hazardous environment. They use predefined swarm 
patterns with an objective of maximizing the target detection probability in minimum expected 
time and using minimum number of UAVs having limited communication range. Beard and 
McLain [9] develop strategies for a team of cooperating UAVs to visit regions of opportunity 
without collision while avoiding hazards in a search area using dynamic programming methods. 
The UAVS are also required to stay within communication range of each other. Flint et al. [10] 
provide a model and algorithm for path planning of multiple UAVs searching in an uncertain and 
risky environment, also using a dynamic programming approach. For this purpose, the search area 
is divided into cells and in each cell the probability of existence of a target is defined. Pfister [11] 
uses fuzzy cognitive map to model the cooperative control process in an autonomous vehicle. In 
[12]-[14] the authors use distributed reinforcement learning and planning for cooperative multi- 
agent search. The agents learn about the environment online and store the information in the 
form of a search map and utilize this information to compute online trajectories. The agents are 
assumed to be having limitation on maneuverability, sensor range and fuel. In [13] the authors 
show a finite lower bound on the search time. Rajnarayan and Ghose [15] use concepts from 
team theory to formulate multi-agent search problems as nonlinear programming problems in a 
centralized perfect information case. The problem is then reformulated in a Linear-Quadratic- 
Gaussian setting that admits a decentralized team theoretic solution. Dell et al. [16] develop 
an optimal branch-and-bound procedure with heuristics such as combinatorial optimization, 
genetic algorithm and local start with random restarts, for solving constrained-path problems 
with multiple searchers. Sujit and Ghose [17] use concepts of graph theory and game theory 
to solve the problem of coordinated multi-agent search. They partition the search space into 
hexagonal cells and associate each cell with an uncertainty value representing lack of information 
about the cell. As the agents move through these cells, they acquire information, reducing the 
corresponding uncertainty value. Jin et al. [18] address a search and destroy mission problem in 
a miUtary setting with heterogeneous team of UAVs. 

Mobile agents equipped with sensors to gather information about the search area form a sensor 
network. Optimal deployment of these sensors or agents carrying sensors which is referred to as 
"sensor coverage" in the literature, is an important step in achieving effective search. Voronoi 
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partition and its variations are used in sensor network literature. We review the concept of 
Voronoi partition and some literature on multi-agent systems using this concept. 

C. Voronoi partition in sensor network and multi-agent systems 

Voronoi partition (named after Georgy Voronoi [19]), also called Dirichlet tessellation (named 
after Gustav Lejeune Dirichlet [20]), is a widely used scheme of partitioning a given space based 
on the concept of "nearness" of objects such as points in a set to some finite number of pre- 
defined locations in the set. In its standard setting Euclidean distance is used as a measure of 
"nearness" (see [21] for a survey). This concept finds application in many fields such as CAD, 
image processing [22], [23] and sensor coverage [24], [25]. There are various generalization of 
the Voronoi decomposition such as weighted Voronoi partitions and Voronoi partition based on 
non-Euclidean metric. The dual of Voronoi diagram is the Delaunay graph (named after Boris 
Delaunay [26]). These two concepts are very useful in multi-agent search. 

A class of problems known as locational optimization (or facility location) [27], [28], is 
used in many applications. These concepts have been used in sensor coverage literature for 
optimal deployment of sensors. Centroidal Voronoi configuration is a standard solution for 
this class of problems [29], where the optimal configuration of agents is the centroids of the 
corresponding Voronoi cells. Cortes et al. [24], [25] use these concepts to solve a spatially 
distributed optimal deployment problem for multi-agent systems. A density distribution, as a 
measure of the probability of occurrence of an event along with a function of the Euclidean 
distance providing a quantitative assessment of the sensing performance, is used to formulate 
the problem. Centroidal Voronoi configuration, with centroid of a Voronoi cell, computed based 
on the density distribution within the cell, is shown to be the optimal deployment of sensors 
minimizing the sensory error. The Voronoi partition becomes the natural optimal partitioning due 
to monotonic variation of sensor effectiveness with the Euclidean distance. Schwager et al. [30] 
interpret the density distribution of [25] in a non-probabilistic framework and approximate it 
by sensor measurements. Pimenta et al. [31] follow a similar approach to address problem with 
heterogeneous robots. They let the sensors to be of different types (in the sense of having different 
footprints) and relax the point robots assumptions. Generalization of Voronoi partition such as 
power diagrams (or Voronoi diagram in Laguerre geometry) are used to account for different 
footprints of the sensors (assumed to be discs). Due to assumption of finite size of robots, the 
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robots are assumed to be discs and a free Voronoi region is defined. A constrained locational 
optimization problem is solved. They also extend the results to non-convex environments. Ma 
et al. [32] use an adaptive triangulation (ATRI) algorithm based on the Delaunay triangulation 
[26], which is a dual of the Voronoi partition, with length of the Delaunay edge as a parameter, 
to achieve non-uniform coverage. 

In [33]-[35] authors address a problem of searching an unknown area with a priori known 
uncertainty distribution using multiple agents. The concept of Voronoi partition was used in for- 
mulating optimal deployment strategies for multiple agents maximizing the search effectiveness. 

D. Motivation and contribution of the paper 

In the literature on multi-agent search, it is largely assumed that the agents and the sensors are 
homogeneous in nature. But this assumption may not be valid in many practical applications. It 
is most likely that the sensors will have varied capabilities in terms of the strength and range, 
making the problem heterogenous in nature. We address this issue in this paper, and formulate 
and solve a heterogeneous multi-agent search problem. In order to solve this problem, we present 
a generalization of the standard Voronoi partition and use it to design an optimal deployment of 
heterogeneous agents. 

The generalization of the Voronoi partition proposed in this work takes into account the 
heterogeneity in the sensors' capabilities, in order to design an optimal deployment strategy for 
heterogeneous agents. The agent locations are used as sites or nodes and a concept of a node 
function, which is the sensor effectiveness function associated with each node is introduced in 
place of the usual distance measure. The standard Voronoi partition and many of its variations 
can be obtained from this generalization. 

In [24], [25], [30] authors use Voronoi partitions for optimal deployment of homogeneous 
sensors and [31] use power diagrams for the case of heterogeneous agents. In [33]-[35], authors 
use Voronoi partition to design multi-agent search strategies for agents with homogeneous sen- 
sors. In this paper, we generalize these concepts and incorporate the sensors with heterogeneous 
capabilities. The optimal deployment strategy is developed based on the generalized Voronoi 
partition maximizing the search effectiveness in a given step and forms the basis for two 
heterogeneous multi-agent search strategies namely, heterogeneous sequential deploy and search 
and heterogeneous combined deploy and search. We provide convergence results for the search 
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Strategies and also analyze the strategies for spatial distributedness property. Some preliminary 
results using heterogeneous sensors have been earlier reported in [36]. The concepts developed 
in this work are based on and generalization of those provided in [33], [34]. 

E. Organization of the paper 

The paper is organized as follows. We preview a few mathematical concepts used in this work 
in Section II. In Section III we provide a generalization of Voronoi partition. In Section IV we 
formulate a heterogeneous multi-agent search problem. The multi-center objective function, its 
critical points, the control law responsible for motion of agents, and its convergence and spatial 
distributedness property are also discussed here. In Section V we impose a few constraints 
on the agents' speeds and provide the convergence proof for the agents' trajectories with the 
corresponding control laws. In Section VI we propose and analytically study the heterogeneous 
sequential deploy and search strategy. In Section VII we propose and analyze the heterogeneous 
combined deploy and search strategy. We study the effect of limit on sensor range in Section 
VIII and discuss a few implementation issues in Section IX. Simulation results and discussions 
are provided in Section X, and finally the paper concludes in Section XI with possible directions 
for future work. 

II. Mathematical preliminaries 

In this section we preview mathematical concepts such as LaSalle's invariance principle and 
Liebniz theorem used in the present work. 

A. LaSalle's invariance principle 

Here we state LaSalle's invariance principle [37], [38] used widely to study the stability of 
nonlinear dynamical systems. We state the theorem as in [39] (Theorem 3.8 in [39]). 
Consider a dynamical system in a domain D 

X = fix), f-.D^R'' (1) 

Let V : D ^ Rhe a continuously differentiable function and assume that (i) M C -D is a 
compact set, invariant with respect to the solutions of ([I]); (ii) V < in M; (iii) E : {x : x E 
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M, and V{x) = 0}; that is, E is set of all points of M such that V{x) = 0; and (iv) is the 
largest invariant set in E. Then every solution of © starting in M approaches as t — > oo. 

Here by invariant set we mean that if the trajectory is within the set at some time, then it 
remains within the set for all time. Important differences of the LaSalle's invariance principle as 
compared to the Lyapunov Theorem are (i) V is required to be negative semi-definite rather than 
negative definite and (ii) the function V need not be positive definite (see Remark on Theorem 
3.8 in [39], pp 90-91). 

B. Leibniz theorem and its generalization 

The Leibniz theorem is widely used in fluid mechanics [40], and shows how to differentiate 

an integral whose integrand as well as the limits of integration are functions of the variable with 

respect to which differentiation is done. The theorem gives the formula 

d f^^^^ ^, ^ , /■'' , dh ^„ ^ da^, ^ 
— E{x,y)dx= —dx+—E{b,y)-—E{a,y) (2) 
dyJa(y) J a dy dy dy 

Eqn. ^ can be generalized for a d-dimensional Euclidean space as 

F(x,y)dV= [ ^dV+ [ n(x).u(x)FdS (3) 
Jv dy Js 

where, V C M"^ is the volume in which the integration is carried out, dV is the differential 
volume element, S is the bounding hypersurface of V, n(x) is the unit outward normal to S 
and u{x) = ^(x) is the rate at which the surface moves with respect to y at x E S. 

III. Generalization of the Voronoi partition 

Here we present a generalization of the Voronoi partition considering the heterogeneity in 
the sensors' capabilities. Voronoi partition [19], [20] is a widely used scheme of partitioning a 
given space and finds applications in many fields such as CAD, image processing and sensor 
coverage. We can find several extensions or generalizations of Voronoi partition to suit specific 
applications [21], [23], [28]. Herbert and Seidel [41] have introduced an approach in which, 
instead of the site set, a finite set of real-valued functions /j : D i-^ M is used to partition the 
domain D. Standard Voronoi partition and other known generalizations can be extracted from 
this abstract general form. 

In this paper we define a generalization of the Voronoi partition to suit our application, namely 
the heterogeneous multi-agent search. We use, (i) the search space as the space to be partitioned. 
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(ii) the site set as the set of points in the search space which are the positions of the agents in 
it, and (iii) a set of node functions in place of a distance measure. 

Consider a space Q C M*^, a set of points called nodes or generators V — {pi,P2, ■ ■ ■ ,Pn}, 
Pi e Q, with Pi ^ pj, whenever i ^ j, and monotonically decreasing analytic functions [42] 
fi : ]R+ I— > R, where /j is called a node function for the i-th node. Define a collection {Vi}, 
i e {1,2, .. . , A^}, with mutually disjoint interiors, such that Q = ^i£{i,2,...,N}Vi, where Vi is 
defined as 

Vi^{qeQ\fi{\\pi-q\\)>fj{\\pj-q\\) ^j^i, j G {1, 2, . . . , TV}} (4) 

We call {V^}, i e {1,2,..., N}, as a generalized Voronoi partition of Q with nodes V and 
node functions fi. In the standard definition of the Voronoi partition, — ^ fj{\\Pj — Q\\) 

is replaced by {\\pi — q\\) < {\\pj — q\\). Note that, 

i) Vi can be topologically non-connected and may contain other Voronoi cells. 

ii) In the context of multi-agent search problem discussed in this paper, q E Vi means that 
the i-th agent is the most effective in performing search task at point q. This is reflected 
in the > sign in the definition. In standard Voronoi partition used for the homogeneous 
multi-agent search, < sign for distances ensured that i-th agent is most effective in Vi 

iii) The condition that f are analytic implies that for every i,j e {1,2,..., N}, f — fj is 
analytic. By the property of real analytic functions [42], the set of intersection points between 
any two node functions is a set of measure zero. This ensures that the intersection of any 
two cells is a set of measure zero, that is, the boundary of a cell is made up of the union 
of at most d — 1 dimensional subsets of W'-. Otherwise the requirement that the cells should 
have mutually disjoint interiors may be violated. Analyticity of the node functions fi is a 
sufficient condition to discount this possibility. 

iv) The standard Voronoi partition and its generalizations such as multiplicatively and additively 
weighted Voronoi partitions can be extracted as special cases of the proposed generalization. 

Theorem 1: The generalized Voronoi partition depends at least continuously on V. 
Proof: If Vi and Vj are adjacent cells, then all the points q E Q on the boundary common to them 
are given by {q e Q\fi{\\pi — q\\) — fj{\\Pj — q\\)}, that is, the intersection of corresponding node 
functions. Let the j-th agent moves by a small distance dp. This makes the common boundary 
between Vi and Vj move by a distance, say dx. Now as the node functions are monotonically 
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decreasing and are continuous, it is easy to see that dx ^ as dp 0. This is true for any pair 
i and j. Thus, the Voronoi partition depends continuously onV = {pi,P2, ■ ■ ■ iPn}- □ 

Generalized Delaunay graph 

Delaunay graph is the dual of Voronoi partition. Two nodes are said to be neighbors (connected 
by an edge), if the corresponding Voronoi cells are adjacent. This concept can be extended to 
generalized Voronoi partitioning scheme. For the sake of simplicity we call such a graph a 
Delaunay graph, Qd- Note that the generalized Delaunay graph, in general, need not have the 
property of Delaunay triangulation, in fact, it need not even be a triangulation. 

Two nodes are said to be neighbors in a generalized Delaunay graph, if the corresponding 
generalized Voronoi cells are adjacent, that is, e Sg^^, the edge set corresponding to the 
graph Gd, if n ^ 0. 

IV. Heterogeneous Multi-Agent Search 

hi this section we discuss the problem addressed in this paper. agents are deployed in the 
search space Q C M'^, a convex polytope, where, lack of information is modeled as an uncertainty 
density distribution : Q i— > [0, 1], a continuous function in Q. P{t) — {pi{t) , P2{t) , ■ ■ ■ ,PN{t)}, 
Pi{t) e Q denotes the configuration of the multi-agent system at time t, pi{t) denotes the position 
of the i-th agent at time t. In future, for convenience, we drop the variable t and refer to the 
positions by just pi. The agents are assumed to have sensors with varied strength and range, 
whose effectiveness at a point reduces with distance. The agents get deployed in Q, perform 
search, thereby reducing the uncertainty, and we are looking for optimal utilization of the agents 
to reduce the uncertainty (t){q) at each point q&Q below a specified level. 

At each iteration, after deploying themselves optimally, the sensors gather information about 
Q, reducing the uncertainty density as, 

(t>n+\{q) = (t>n{q) vtAn{(5i{\\pi - q\\)} (5) 

where, is the density function at the n-th. iteration; /3 : M i-^ [0, 1] is a function of the 

Euclidian distance of a given point in space from the agent, and acts as the factor of reduction 
in uncertainty by the sensors; and Pi is the position of the i-th sensor. At a given q E Q, only the 
agent with the smallest — ?||), that is, the agent which can reduce the uncertainty by the 
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largest amount, is active. If any agent searches within its Voronoi cell, then the updating function 
^ gets implemented automatically. That is, the function mini{/?j(||]9j — g||)} is simply f3i{\\pi — 
q\\), where pi E Vi. Usually, sensors' effectiveness decreases with Euclidean distance, thus Pi, 
which represents the search effectiveness of i-th sensor, can be assumed to be a monotonically 
increasing analytic function of the Euclidean distance. Equation ^ selects the agent i, which is 
most effective in performing search task at point q E Q. We will discuss more about the function 
Pi in a later section. 

Note that the condition that 0o is continuous ensures that 0„ is continuous for all n as Pi 
are continuous and at any point q E Q, and on the boundary of generalized Voronoi cells 
corresponding to any pair of agents i and j, Pi{\\pi — q\\) = Pj{\\Pj — q\\), by the definition of 
the generalized Voronoi partition. 

A. Objective function 

Now suppose that the agents have to be deployed in Q in such a way as to maximize one- 
step uncertainty reduction, that is, maximize the effectiveness of one-step of multi-agent search. 
Consider the objective function for the n-th search step, 

7e = ! AMq)dQ= [ {Mq)-mm{P,{\\p,-q\\)}Mq))dQ 
JQ JQ 

= [ Mq)a-Pri\\Pi-Q\\))dQ = y2 [ <Pn{q)h{ri)dQ (6) 

where, Vi is the generalized Voronoi cell given by dU corresponding to the i-th agent, with 
fi{.) = 1 — Pi{.), a monotonically decreasing analytic function as node function, V as the set 
of nodes, and = \\pi — q\\. Below we provide a result which will be useful in obtaining the 
critical points of the objective function 

Lemma 1: The gradient of the multi-center objective function Q with respect to Pi is given 



dpi Jvi dp, 
where rj = ||g — pi\\. 
Proof. Let us rewrite ^ as 

7e= (8) 

iG{l,2,...Af} 
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where TV^ = Jy^ Mr^)(j){q)dQ. Now, 



j€{l,2,...N} 

Applying the general form of the Leibniz theorem [40] 



dpi 



m^ir,)dQ+J2 [ n,,(g).u,,(g)0(g)/,(r,)f/g (10) 

where, Ni is the set of indices of agents which are neighbors of the i-th agent in Qo, the 
generalized Delaunay graph, Aij is the part of the bounding surface common to Vi and Vj, 
nij{q) is the unit outward normal to Aij at g G Aij, Ujj (g) = -^{q), the rate of movement of 
the boundary at g G Aij with respect to pi. 

Note that i) nij{q) = -nji{q), Vg G Aij, ii) Uij{q) = Uji{q), iii) fi{ri) = fj{rj), Vg G Ay, by 
definition of the generalized Voronoi partition, and iv) is continuous. Thus, it is clear that for 
each j G Ni, nij{q).Uij{q)(t){q)fi{ri)dQ = - nji{q).Uji{q)(j){q)fj{rj)dQ, and hence, the 
last two terms in (fTOl) cancel each other. □ 



B. The critical points 

The gradient of the objective function ^ with respect to pi, the location of the i-th node in 
Q, can be determined using (|7]) (by Lemma [T]) as 



dpi Jv, dpi Jv^ d{ri 

~^mp-^-q)dQ = -MvM-Cv.] 



where, rj = ||g — Pt|| and 0(g) = —<t>{q)^ir^- As fi,i G {1,2,...,A^} is strictly decreasing, 
(j){q) is always non-negative. Here My^ and C*y^ are interpreted as the mass and centroid of the 
cell Vi with as density. Thus, the critical points are pi = Cy^, and such a configuration V, of 
agents is called a generalized centroidal Voronoi configuration. 

Theorem 2: The gradient, given by (fTTT) . is spatially distributed over the generalized Delaunay 
graph Qd- 

Proof. The gradient (fTT)) with respect to pi G V, the present configuration, depends only on 
the corresponding generalized Voronoi cell Vi and values of and the gradient of fi within Vi. 
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The Voronoi cell Vi depends only on the neighbors of Pi in Qd. Thus, the gradient (fTTI) can be 
computed with only local information, that is, the neighbors of pi in Qd. □ 
The critical points are not unique, as with the standard Voronoi partition. But in the case of 
a generalized Voronoi partition, some of the cells could become null and such a condition can 
lead to local maxima. 

C. Selection of (3i 

The function /5j : M i-^ [0, 1] is a sensor detection function corresponding to the z-th agent. 
The effectiveness of most sensors decreases with the Euclidean distance. Consider 

/3i(r) = 1 - fciC""'"-', ki e (0, 1) and > (11) 

2 

Here, fcje""^^' represents the effectiveness of the i-th sensor which is maximum at = 
and tends to zero as r ^ oo and Pi is minimum at = (effecting maximum reduction in 
</)) and tends to unity as r ^ oo (change in (p reduces to zero as r increases). Most sensors' 
effectiveness reduces over distance as the signal to noise ratio increases. Thus Pi, which is upside 
down Gaussian, can model a wide variety of sensors with two tunable parameters ki and a^. 

D. Special cases 

Here we discuss a few interesting detection functions. 

Case 1: Pi{ri) = 1 — A;e~"'''?.' Here we consider exponential sensor effectiveness and assume 
that the parameter a is different for different sensors while k remains the same for all of them, 
that is, all the agents have sensors with the same maximum effectiveness with different sensor 
reach (Figured] (a)). This case leads to multiplicatively weighted Voronoi partition. The Voronoi 
cells can be non-connected and also can have one or more Voronoi cells embedded within a 
cell. Within V^, = -ai0„(-)A;e-"»'^?. 

Figure [11(d) shows a Voronoi partition for this case with k = 0.8. The parameter k does not 
affect the Voronoi partition. It is easy to show that the partition is a multiplicatively weighted 
Voronoi partition with weights ^/al. The Voronoi cell corresponding to node with = 0.6, the 
highest «j among all the nodes, implying that it is the least effective, is embedded within the 
cell corresponding to the node with ctj = 0.08, the smallest value, and hence the most effective. 
The Voronoi cell corresponding to the node with ctj = 0.05 is actually two cells separated by 
the cell corresponding to node with ai = 0.2. 
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(d) (e) (f) 

Fig. 1. The sensor effectiveness /3i(r) = 1 — fc^e with a) varying at, b) varying ki, and c) both Oi and ki varying, d), 

e), and f) are the corresponding Voronoi partitions with '*' showing the locations of nodes or sites, the numbers indicating the 

parameters, and dotted lines showing the standard Voronoi partition. 

Case 2. (3i{ri) = 1 — k^e'^^^h Here we let the parameter ki be different for different sensors 
while keeping the value of a same. The agents in this case have sensors with varying maximum 
effectiveness (Figure [T] (b)). Within Vi, (j)n{-) = — a;0c)A;je~"''?. 

Theorem 3: For Q C M?, the boundaries of Voronoi cells corresponding to the case Pi{r) = 
1 — kiC'"^ are straight line segments. 

Proof. Let q = (x, y)' be a point on the boundary of cells Vi and Vj. Then we have, 

fc^e-"(IIPi-«ll)' = A;2e-"(ll''2-«ll)' (12) 
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Now let pi = (pii,Pi2)' and p2 = (^21,^22)'- Solving for q from (fT2l) gives, 

_ (Pii -P21) , (l/a)/n(A;i/A;2) + (P21 +P22) - (Pii +P12) _ ,^ .1^. 
(P22 - P12) 2(p22 - P12) 

where, M and C are constants for a given V. Eqn. (fT3l) is true for any q on the boundary of 
cells Vi and Vj and hence, the boundary is a straight line segment. □ 

Figure [He) shows the corresponding Voronoi partition along with the standard Voronoi parti- 
tion. Each cell is made up of line segments. 

Case 3. (3i{ri) = 1 — kiC'^^^^ : Here we vary both the parameters. This case is in the general 
category of Voronoi partitions (HI). Within Vi, (pni,-) = —o:i4'n{-)kie~°''^i 

Figure \T\ (f) shows the corresponding Voronoi partition along with the standard Voronoi 
partition, while Figure [T] (c) shows corresponding sensor effectiveness. 

Case 4. 1 — Pi{ri) = —rf: Here we relax the condition that I3i{-) E [0, 1]. This will lead to 
standard centroidal Voronoi configuration [24], [25]. 

E. The control law 

The critical points of the objective function ([6]) are the respective centroids. Here we discuss 
a control law making the agents move toward respective centroids. 

Typically search problems do not consider dynamics of search agents as the focus is more on 
the effectiveness of search, that is, being able to identify region of high uncertainty and distribute 
search effort to reduce uncertainty. Moreover, it is usually assumed that the search region is large 
compared to the physical size of the agent or the area needed for the agent to maneuver. We 
assume the first order dynamics for agents to demonstrate the search strategy presented in this 
work. Let us consider the system dynamics as 

Pi = Ui (14) 

Consider the control law 

Ui = -kpropiPi - CVi) (15) 

Control law ([15]) makes the agents move toward for positive gain kprop- 

It is not necessary that Cvi £ ^> but E Q is true always and this fact ensures that Q is 
an invariant set for ([T4|) under ([T5l). 
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Remark 2. It can be seen that the control law (fT5l) is spatially distributed over the generalized 
Delaunay graph Qo- 

Theorem 4: The trajectories of the agents governed by the control law (fT5l) . starting from any 
initial condition V{0) E Q'^, will asymptotically converge to the critical points of 7i". 
Proof . Here we will use LaSalle's invariance discussed earlier. Consider V{V) = —Ti^. 

= -2akprop Ei {pi -Cv,f 

We observe that V : Q i-^ M is continuously differentiable in Q by Theorem [B M = Q is 
a compact invariant set; V is negative definite in M; E = V^^{0) = {Cvt} which itself is the 
largest invariant subset of E by the control law (fT5l) . Thus by LaSalle's invariance principle, the 
trajectories of the agents governed by control law (fT5l) . starting from any initial configuration 
V{0) E Q^, will asymptotically converge to set E, the critical points of □ 

It can be noted that the centroid is computed based on the density information. The generalized 
Voronoi partition is updated as the agents move and the centroids are recomputed. At the end 
of a deployment step, the control law (fT5l) ensures that each agent is at (or sufficiently close to) 
the centroid of the corresponding generalized Voronoi cell, guaranteeing maximal uncertainty 
reduction. It is known that the gradient descent/ascent is not guaranteed to find a global optimal 
solution (see [24] and references therein). Thus, we can only guarantee a local optimum to the 
optimization problem. 

To implement the control law, centroid of each generalized Voronoi cell needs to be computed. 
The computational overhead of computing the centroid can be reduced at the cost of slower 
convergence using methods reported in the literature such as random sampling and stochastic 
approximation [22], [43]. In addition, we discretize the search space into grids while implement- 
ing the strategy. This simplifies the computation of the centroid of generalized Voronoi cells. 
There are a few efficient algorithms implementing computation related to standard Voronoi 
partition. Addressing the computational related issues and development of efficient algorithms 
for computing the generalized Voronoi partitions will help implementating the search strategies 
presented in this paper more effectively. The main focus of this work is design and demonstration 
of heterogenous multi-agent search strategies and finer issues such as computation complexities 
are beyond the scope of this paper. 
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V. Constraints on agents' speed 

We proposed a control law to guide the agents toward the critical points, that is, to their 
respective centroid, and observed that the closed loop system for agents modeled as first order 
dynamical system, is globally asymptotically stable. Here we impose some of constraints on the 
agent speeds and analyze the dynamics of closed loop system. 

A. Maximum speed constraint 

Let the agents have a constraint on maximum speed of Umaxi, for i = 1, . . . ,n. Now consider 
the control law 

^propiPi ^Vi) If — UjYidxi 

-"-'lists 

The control law (flTI) makes the agents move toward their respective centroids with saturation 
on speed. 

Theorem 5: The trajectories of the agents governed by the control law (flTl) . starting from any 
initial condition P(0) G , will asymptotically converge to the critical points of 
Proof. Consider V{V) = -H". 

^ y ) — dt ~ Z^ie{l,2,...,Ar} dpi t^i- 

2« Z)ig{l,2,...,Af} ^vAPi - Cv,){-kprop){Pi - Cvi), If Ui < Umaxi 

(p —C ) 

2« Eig{i,2,...,7V} MvAVi - gv;)(-^maxj (||p]_^)^j|) , othcrwlsc (18) 

-2« EiG{i,2,...,7V} Umax^Mv, ffc^^lr' ^^herwise 
We observe that : Q ^-^ M is continuously differentiable in Q as {Vi} depends at least 
continuously on V (Theorem [T]), and V is continuous as u is continuous; M = Q is a compact 
invariant set; V is negative definite in M; E = V^^{0) = {Cv^}^ which itself is the largest 
invariant subset of E by the control law (flTI) . Thus, by LaSalle's invariance principle, the 
trajectories of the agents governed by control law ([17] ). starting from any initial configuration 
V{0) E Q'^, will asymptotically converge to the set E, the critical points of 7i", that is, the 
generalized centroidal Voronoi configuration with respect to the density function as perceived 
by the sensors. □ 
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B. Constant speed control 

The agents may have a constraint of moving with a constant speed Ui. But we let the agents 
slow down as they approach the critical points. For i = 1, . . . ,n, consider the control law 

Ui = < IKp'-^v-JII (J9^) 
\-Ui{pi - CvJ, otherwise 
The control law (fT9l ) makes the agents move toward their respective centroids with a constant 
speed of f/j > when they are far off from the centroids and slow down as they approach them. 

Theorem 6: The trajectories of the agents governed by the control law (fT9l) . starting from any 
initial condition V{0) E , will asymptotically converge to the critical points of 7i". 
Proof. Consider V{V) = —H", where V = {pi,P2, ---^Pn} represents the configuration of 
agents. 



V(V) - 92fi^, 
^ y ) — dt ~ l^ie{i,2,...,N} dpiPl 

= 2«E..{i,2,...,^} MvM - ^vJ(-f/.)(|£E^ 



(20) 



-2a Eie{i,2,...,iv} U.MvXPi - CvJ, otherwise 
We observe that : Q t— > IR is continuously differentiable in Q as {Vi} depends at least 
continuously on V (Theorem [T]), and V is continuous as u is continuous; M = Q is a compact 
invariant set; V is negative definite in M; E = V^^{0) = {Cy^}, which itself is the largest 
invariant subset of E by the control law (fT9l ). Thus, by LaSalle's invariance principle, the 
trajectories of the agents governed by control law (fT9l ). starting from any initial configuration 
V{0) E , will asymptotically converge to the set E, the critical points of 7i", that is, the 
generalized centroidal Voronoi configuration with respect to the density function as perceived 
by the sensors. □ 

VI. Heterogenous sequential deploy and search (HSDS) 

In this strategy, the agents are first deployed optimally according to the objective function Q 
and the search task is performed reducing the uncertainty density at the end of the deployment 
step. This iteration of "deploy" and "search" in a sequential manner continues till the uncertainty 
density is reduced below a required level. The iteration count n in © refers to the number of 
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"deploy and search" steps. The control law (fT5l) is used to make the agents move toward the 
critical points, that is, the centroids of the corresponding cells. 

Remark 3. It is straightforward to prove that the heterogeneous sequential deploy and search 
strategy is spatially distributed over the generalized Delaunay graph Qo- 

Theorem 7: The heterogeneous sequential deploy and search strategy can reduce the average 
uncertainty to any arbitrarily small value in a finite number of iterations. 
Proof. Consider the uncertainty density update law ([5]) for any q E Q, 

(f)^{q) = (1 - k,e-''^'^")<f)n-i{q) = 7n-i0n-i(g) (21) 

where, is the distance of point q E Q from the i-th agent, such that q E Vi, the Voronoi 
partition corresponding to it and define 7„_i = (1 — /cjC""*'"'^). Note that in HSDS, the agents 
are located in respective centroid at the time of performing search. 
Applying the above update rule recursively, we have, 

7i7o0o(<?) (22) 

Let D{Q) = maxp^gggdl p — q ||). It should be noted that 

1. 0<ki<l 

2. < Tj < D{Q). D{Q) is bounded since the set Q is bounded. 

3. < 7j < 1 - /ce-^-t^e^)'^ = / (say), j E N; and / < 1, where k = mmi{ki) and 
a = maXj(a;j) 

Now consider the sequence {F} , 

Tn = 7n7n-l • • • 7l70 < ^""^^ 



Taking limits as n — ^ oo. 



Thus, 



lim r„ < lim / 

?i— >oo n— >oo 



n+1 



lim 0„(g) = lim r„_i0o(«?) = 



n— >oo n^oo 



As the uncertainty density vanishes at each point q E Q in the limit, the average uncertainty 
density over Q is bound to vanish in the limit as n ^ oo. Thus, the HSDS strategy can reduce 
the average uncertainty to any arbitrarily small value in a finite number of iterations. □ 
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It should be noted that the above proof does not depend on the control law. The theorem 
depends only on the outcome of the choice of the updating function ([5]), along with the fact 
that there is no limit on sensor range and the search space Q is bounded. In addition, it does 
not address the issue of the optimality of the strategy which, in fact, depends on the control 
law responsible for the motion of the agents. However, in HSDS, the reduction in uncertainty 
in each "deploy and search" step is maximized. The reduction in the uncertainty in each step in 



which is the maximum possible reduction in a single step. The deployment is such that uncertainty 
will be reduced to a maximum possible extent in a step, given by the above formula. 

VII. Heterogeneous combined deploy and search (HCDS) 

Here we propose a heterogeneous combined deploy and search (HCDS) strategy, where, instead 
of waiting for the completion of optimal deployment, as in HSDS, agents perform search as they 
are moving toward the respective centroids in discrete time intervals. 

A. Density update 

Here we provide the problem formulation for the heterogeneous combined deploy and search 
strategy. Assume that the index n represents the intermediate step at which the search is per- 
formed and uncertainty density is updated. Using the uncertainty density update rule Q discussed 
earlier we can get. 



HSDS is 




(23) 



^n<t){q) = </>n+i(g) - Mq) = Mq) min(l - pi - q ||)) 



(24) 



Define, 




Q 



(25) 



Integrating (|24)) over Q, 




(26) 
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B. Objective function 

The objective function used for heterogeneous sequential deploy and search strategy, is 
fixed for each deployment step as (f)n{Q) is fixed for the n-th iteration. In heterogeneous combined 
deploy and search, the search task is performed as the agents move. The following objective 
function is maximized in order to maximize the uncertainty reduction at the n-th search step, 

7^'^ = A$„= Yl I ^n{q){l-m\P^-q\\))dQ (27) 

Note that the above objective function is same the as ^ except for the fact that n in this case 
represents the search step count, whereas in Q it represents "deploy and search" step count. 
For (3i{r) = 1 — kie'""'^^ , the objective function (|27l) becomes, 

5^ f Mq)he-''''^dQ (28) 
ie{i,2,...,N} 

It can be noted that for a given n, the uncertainty density at any q G Q is constant. 

Thus, the gradient of the objective function (l28l) with respect to pi can be computed as in HSDS. 
The gradient is given as. 



L,2,...,Af} 

2aiMvXPi - Cv^) (29) 



As in the case of HSDS, the critical points for any given n are pi = Cy^- But the uncertainty 
changes in every time step and hence the critical points also change. Hence, the corresponding 
critical points are only the instantaneous critical points. As the instantaneous critical points of 
the objective function (l28l) are similar to those of we use (fT5l) . the control law used for 
HSDS strategy. 

The instantaneous critical points and the gradient (|29l) are used in control law ([T?] ) only to make 
the agents move toward the instantaneous centroid rather than deploying them optimally. Thus, 
it is not possible to prove any optimality of deployment and we do not prove the convergence of 
the trajectories here in case of HCDS. Agents perform more frequent searches instead of waiting 
till the optimal deployment maximizing per step uncertainty reduction. 

Remark 4. It is straightforward to show that the continuous time heterogeneous combined deploy 
and search strategy is spatially distributed over the generalized Delaunay graph Qo- 
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Theorem 8: The heterogeneous combined deploy and search strategy can reduce the average 
uncertainty to any arbitrarily small value in finite time. 

Proof. The proof is similar to Theorem |7] as the density update law is the same. The differences 
are that, i) in heterogeneous combined deploy and search, the density update occurs every time 
step and n represents search step count rather than 'deploy and search' count, and ii) the agent 
configuration in Eqn. (|2T)) need not be optimal. Even when the agent configuration is non-optimal, 
7„ are strictly less than unity as noted in the proof of Theorem |7l □ 
As in the case of HSDS, it should be noted that the above proof does not depend on the 
control law. The theorem depends only on the outcome of the choice of the updating function 
©, along with the fact that there is no limit on sensor range and the search space Q is bounded. 
In addition, it does not address the issue of the optimality of the strategy which, in fact, depends 
on the control law responsible for the motion of the agents. In HCDS, instead of waiting till 
the single step uncertainty reduction is maximized, agents perform frequent searches. Though 
the amount of uncertainty in each step is less than that in HSDS, increased instances of search 
ensure faster reduction in uncertainty density. 



We have not considered any limitation on the sensor range in formulating the multi-agent 
search strategies in previous sections. But in reality the sensors will have limited range. In this 
section we formulate search problem for heterogeneous agents having limit on their sensor range. 

Let Ri be the limit on range of the sensors and B{pi, Ri) be a closed ball centered at pi with a 
radius of Ri. The i-th sensor has access to information only from points in the set ViHEipi., Ri). 
Let us also assume that fi{Ri) = fj{Rj), G {1, . . . , A^}, that is, we assume that the cutoff 
range for all sensors is same. Consider the objective function to be maximized. 



VIII. Limited range sensors 




(30) 



where. 




fi{Ri) otherwise 




with /,(■) = 1 - A(-) and /,(■) = 1 - 
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Fig. 2. Illustration of fi and fi in presence of the limit on sensor range. The solid curve represent the sensor effective function 
fi and dotted curve is the actual sensor effective function fi{r) = fi{r) + {1 ~ fi{R)) with R = 6. 

It can be noted that the objective function is made up of sums of the contributions from sets 
Vi n B(pi, Ri), enabling the sensors to solve the optimization problem in a spatially distributed 
manner. 

In reality for range limited sensors the effectiveness should be zero beyond the range limit. 
Consider = — fi{Ri). It can be shown that the objective function (|30l) has the same 
critical points if fi is replaced with fi, as the difference in two objective functions will be a 
constant term fi{Ri) (Note that we have assumed fi{Ri) = fj{Rj)\/i,j G {1, . . . , A^}.). 

The gradient of (l30l) with respect to pi can be determined as 

(P) = 2M^VinBip„R)){C(VinB{p„R) - Pi) (31) 

We use the control law 

= ~kprop{Pi — QvinsCpi,/?))) (32) 

Remark 5. It is easy to show, that the gradient (|3TI) and the control law (|32|) are spatially 
distributed in the r-limited (generalized) Delaunay graph Gld, the Delaunay graph incorporating 
the sensor range limits. 

Theorem 9: The trajectories of the sensors governed by the control law (|32l) . starting from 
any initial condition V{0), will asymptotically converge to the critical points of H. 
Proof. The proof is similar to that of the Theorem |4] with V = —HiV). It can be shown that 
V is continuously differentiable based on the logic used in Theorem 2.2 in [25]. □ 
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Thus, agents having limited sensor range can also be used in HSDS and HCDS. However, as 
noted earlier. Theorems |7] and [8] are not applicable in this situation as the space spanned by the 
senors is only a subset of the search space Q. 

IX. Implementation issues 

Here we discuss some of the theoretical and implementation issues involved in the proposed 
search strategies namely, heterogeneous sequential deploy and search and heterogeneous com- 
bined deploy and search. 

A single step of heterogeneous sequential deploy and search strategy involves deploying the 
agents optimally, and then performing the search task within the respective Voronoi cells. The 
deployment step can be implemented in continuous time (as given by control law (fT5l) ) or in 
discrete time (as in simulations carried out in this work). When the implementation is in discrete 
time, in each time step, the agents move toward the corresponding centroids and at the end of 
the deployment step, that is, when the agents are sufficiently close (as decided by the prescribed 
tolerance) to the centroids, the search is performed. 

A. Discrete implementation 

We convert the differential equation corresponding to the system dynamics (fT4l) to a difference 
equation. 

— = Ui (33) 
At 

where At is the discrete time step. 

Without loss of generality, we let At = 1 time unit. Then, (|33l) will be simplified as, 

^Pik = Uik (34) 

and the control law (fTSi) takes the form, 

where /c G N is the iteration count. 

The control input Ui^ is the desired speed of the i-th agent at the k-th time step. The agent 
moves with this speed for At time units. With At = 1, Ui^ acts as increment of pi per step. In 
other words = Api = Pi^+i — Pij^. Thus, if At = T time units, then the search task takes 
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place after rriT time units, where m is a non-zero integer, the number of time steps taken to 
achieve the optimal deployment. The process is illustrated in Figure Oa). Search is performed 
at the end of deployment step and the time instances at which search is performed are marked 
with '*'. The consecutive search task is performed at a time interval of at most T time units. 
We define the latency, t^, of the agents as the maximum time taken to acquire the information, 
process it, and successfully update the uncertainty density. Finally, T should be chosen to be 
greater than or equal to tg. 




1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 

time steps time steps 



(a) (b) 

Fig. 3. Illustration of the discrete time implementation of (a) heterogeneous sequential deploy and search strategy 
where deployment takes place according to control law dSSl ) at every time step, and the search task takes place 
at the end of each deployment step indicated by '*'and (b) heterogeneous combined deploy and search strategies 
where search is performed at every step while the agents move according to the control law ( [35] ). 

In the heterogeneous combined deploy and search strategy the agents perform search while 
moving toward corresponding centroids, without waiting till the end of the deployment step. 
The agents perform search after every T time units as they move toward the respective centroids 
according to the discrete control law (l35l) . The process is illustrated in Figure [3tb). Search is 
performed at every time instance as indicated by The plot of distance traveled versus time 
steps is smoother in case of CDS compared to that of SDS. 
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B. Effect of saturation 

The control inputs given by control law (fT5]) or (|35] ) determine the speeds of the agents. In 
practical implementation, it is likely that there will be a constraint on the maximum speed of 
agents. Such a limit will appear as a saturation on the control input. In case of the heterogeneous 
sequential deploy and search strategy, the effect of saturation on control input might lead to 
slower convergence of the deployment step. During the initial few steps, it is likely that the 
control input provided by (fT5l) can cross the saturation limit, whereas later, as the agents approach 
the centroids, the control input naturally reduces (as it is proportional to the distance between 
the agents and the respective centroids). Thus, effect of saturation is at most a possible increase 
in the time gap between consecutive search steps as illustrated in Figure WL^)- 

In the case of heterogeneous combined deploy and search strategy, whenever the control 
effort computed by (fT5l) crosses the saturation limit, the actual speed is limited to the saturation 
value. The time lag between two consecutive search tasks remains fixed at T irrespective of 
the saturation. But, with saturation, the distance traveled by the agents before performing the 
next search task reduces (or remains the same if the control input given by ([151) is less than the 
saturation limit). This is illustrated in Figure Ob). This will probably result in a faster search 
due to frequent searches. 

C. Spatial distributedness 

Here we discuss the implication of spatial distributedness of the proposed search strategies 
from a practical point of view. We have seen that both the search strategies are spatially distributed 
in the generalized Delaunay graph. These results imply that all the agents need to do computations 
based on only local information, that is, by the knowledge about position of neighboring agents. 
Also, the agents should have access to the updated uncertainty map within their Voronoi cells. 
This can be achieved in several ways. One such way is that all the agents communicate with 
a central information provider. But it is not necessary to have this global information. Each 
agent can communicate with its Voronoi neighbors (Mg{i)) and obtain the updated uncertainty 
information in a region Uj\j-g[i)Vi. As the generalized Voronoi partition {Vi} depends at least 
continuously on V, the agent configuration, in an evolving generalized Delaunay graph, the 
communication within the neighbors is sufficient for each agent to obtain the uncertainty within 
its new Voronoi cell. The issues related to communication of uncertainty information are not 
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addressed in the paper except to assume that uncertainty information is available to the agents. 
It is also possible that the agents can estimate the uncertainty map as done in [30]. 

In practical conditions, the agents can communicate with other agents only when they are 
within the limits of the sensor range. The generalized Delaunay graph does not allow sensor 
range limitations to be incorporated. We need to use r -limited generalized Delaunay graph or r- 
generalized Delaunay graph (generalized versions of r-limited Delaunay graph and r-Delaunay 
[44]) to incorporate the sensor range limitations. It needs to be studied if the proposed search 
strategies are still spatially distributed on these graphs. In any case, the scenario changes with 
incorporation of sensor range limitations into the search strategies. The updating of uncertainty 
density will also be within the sensor range limits (in fact, it is within the region fl i?)). 
The centroid that is computed will also be within the new restricted area. For an optimal 
deployment problem, from the perspective of sensor coverage, it has been observed that the 
corresponding control law is still spatially distributed (in r-limited generalized Delaunay graph) 
and globally asymptotically stable. 

D. Synchronization 

Synchronization plays an important role in multi-agent systems. Here we discuss this issue 
for both HSDS and HCDS strategies. In the case of HSDS, theoretically all the agents reach the 
respective centroid at infinite time. But in a practical implementation, the agents are required to 
be sufficiently close, where the closeness is suitably defined, to the respective centroids before 
starting the search operation. It is possible that at any point in time, different agents are at 
different distances from the corresponding centroid. The agents need to come to a consensus as 
to when to end the deployment and perform search operation. We have implemented the strategy 
in a single centralized program using MATLAB. In a practical situation, synchronization can be 
attained by agents communicating a flag bit indicating if an agent has reached its centroid or 
not. When all the agents have reached the respective centroid within a tolerance distance, the 
search can be performed. We also assume that sensing and communication are instantaneous. In 
our simulation experiments we assume such a communication exists. Since the objective of this 
work is to evaluate the effectiveness of the search strategies, we make assumptions that simplify 
implementation without affecting the search effectiveness. 

HCDS operates in a synchronous manner by design. If all the agents start at the same instant 
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of time and have synchronized clocks, the search task is performed by every agent after the 
same interval of time. Given an accurate global clock, synchronization is not a major issue in 
case of HCDS. 

Further in [17] authors provide an asynchronous implementation for coverage control which 
can be suitably modified for HSDS and HCDS. 

X. Results and Discussions 

A few simulation experiments were carried out to validate the proposed heterogeneous multi- 
agent search strategies. We used Pi = 1 — /cje""'''^ i G {1, . . . ,N}. The search space Q is a 
square area of size 10 x 10 in M^. We vary the parameters fcjS and «iS to get different cases. 

Figures |4] and \5\ show results of simulation experiments carried out. Figure Ufa) and (d) show 
the trajectories of the agents for HSDS and HCDS strategies, while Figure^a) shows the average 
uncertainty density history for two strategies with ki = 0.8 and different Oj. Figure [5] (d) shows 
the average uncertainty density with number of searches. The starting location of the agents are 
marked with '+' and end of each of the deploy steps are marked with 'o' along the trajectories 
for the case of HSDS (Figure Ufa)). It can be observed from Figure [5] (a), that HCDS reduces 
uncertainty much faster in time compared to HSDS. HSDS takes requires about 20 time steps 
to reduce the uncertainty below a value of 0.8, while HCDS achieves same reduction in about 
6 time steps. This is due to increased frequency of searches in case of HCDS compared to that 
of HSDS. But Figure [5] (d) reveals that HSDS performs better than HCDS in terms of requiring 
lesser number of search steps for same amount of uncertainty reduction. In case of HSDS, the 
agents get optimally deployed before performing the search and hence, compared to HCDS, the 
uncertainty density is higher in each search step of HSDS. 

Figures |4](b) and (e) show trajectories of agents with = 0.1 and varying for HSDS and 
HCDS, and[5](b) and (e) show the average uncertainty with number of time steps and number of 
search steps for both the strategies. Figures |4] (c) and (f), and [5] (c) and (f) show corresponding 
results with both the parameters ki and ctj varying. Values of the varying parameters have been 
indicated in the figures, near the starting point of each agent which marked with '+'. 

In all the cases, it can be observed that the trajectories of agents with HCDS strategy are 
considerably smoother and shorter than those corresponding to the HSDS strategy, nevertheless, 
both strategies successfully reduce the uncertainty density. The simulation results also indicate 
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that the HCDS strategy performs better even in terms of faster reduction of the average uncer- 
tainty density, while HSDS performs better in terms of requiring fewer search instances. It can 
also be observed that the agents move away from each other covering the search space in a 
cooperative manner. Figures \5\ (a), (b), and (c) illustrate that in HCDS, the search is performed 
at every time instance, and in HSDS, the search is performed only after optimal deployment of 
agents. 

The simulation results demonstrate that both the proposed heterogeneous search strategies 
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Fig. 5. Reduction of uncertainty witli HSDS and HCDS witii time steps for f3i{ri) — 1 — kie"^"^' with (a) at varying, (b) ki 
varying, and (c) both Oi and ki varying. Corresponding reduction in uncertainty with number of search steps are shown in (d), 
(e), and (f). 'o' indicate the search instances. 



perform well as indicated by the theoretical analysis and that the HCDS strategies performs well 
in terms of shorter and smoother agent trajectories and faster uncertainty reduction. 

When the sensors have heterogeneous capabilities either in terms of effectiveness (indicated 
by the parameter ki) or in terms of the range (indicated by the parameter a^), those with higher 
effectiveness share more load, while the weaker ones may remain inactive (in extreme cases 
of heterogeneity). The motivation here is to demonstrate the ability to handle heterogeneity 
in sensors' capabilities. The sensor parameters are assumed to be given and the problem is 
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of designing a suitable search strategy. It might be interesting to select sensors with required 
parameters so as to improve the effectiveness of the search strategy. But this design optimization 
is beyond the scope of this work. 

XI. Conclusions 

We have used a generalization of the Voronoi partition to formulate and solve a heterogeneous 
multi-agent search problem. The agents having sensors with heterogeneous capabilities were 
deployed in the search space in an optimal way maximizing per step search effectiveness. The 
objective function, its critical points, a control law that determines the agent trajectory, its spatial 
distributedness and convergence properties were discussed. Based on the optimal deployment 
strategy, two heterogeneous multi-agent search strategies namely heterogeneous sequential deploy 
and search and heterogeneous combined deploy and search have been proposed and their spatial 
distributedeness and convergence properties have been studied. Effect of constraints on agents' 
speeds and limit on sensor range have been discussed. The simulation experiments demonstrate 
that the search strategies perform well. The heterogeneous combined deploy and search strategy 
is seen to perform better in terms of shorter, smoother agent trajectory and faster search. 

Analysis of the properties of the generalized Voronoi partition is one of the possible direction 
for research. Work on effective algorithms for computation related to generalized Voronoi parti- 
tion will be very useful in effective implementation of the search strategies presented in this paper. 
Further generalization of the Voronoi partition so as to incorporate anisotropy in the sensors 
along with the heterogeneity can also be a very useful exercise. With such a generalization, 
search strategies for multiple agents equipped with heterogeneous and anisotropic sensors can 
be formulated. It is also interesting to explore new applications of the generalized Voronoi 
partition. 
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